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Abstract 

We investigate the problem of enhancement of mutual information by en- 
coding classical data into entangled input states of arbitrary length and show 
that while there is a threshold memory or correlation parameter beyond which 
entangled states outperform the separable states, resulting in a higher mutual 
information, this memory threshold increases toward unity as the length of the 
string increases. These observations imply that encoding classical data into en- 
tangled states may not enhance the classical capacity of quantum channels. 
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1 Introduction 



Consider a quantum channel defined by a completely positive trace preserving map 
p — > £^^^{p). We use £^^^ for describing the action of the channel on one qubit and 
£■{") for its action on a string of qubits of length n. By encoding classical data into 
quantum states and performing optimal measurements at the output, such a channel 
can be used for communicating classical information. One is then faced with the 
natural question of which states are the optimal ones for encoding the input data, 
that is, which ensemble of input states maximize the mutual information between the 
sender and the receiver. 

If the input strings are disentangled and if consecutive uses of the channel are not 
correlated to each other, that is for memoryless channels, then the action of the chan- 
nel on a string pi ^ p2 ■ ■ ■ Pn simple, namely it is given by £^ {pi iSi P2 ■ ■ ■ 'S' Pn) = 
0"=^ £^{pi). However in general one may want to encode classical data into entangled 
strings or, consecutive uses of the channel may be correlated to each other, in which 
case £^ ^ ^ these cases the output strings are no longer simple functions of 
the input strings. 

In these cases we are dealing with a strongly correlated quantum system the cor- 
relations of which either result from the entanglements of the input states, or from 
the memory of the channel itself. And for this reason we should anticipate grave dif- 
ficulties in analytical tackling of the problem. Nevertheless we try to gain an insight 
by studying examples. 

Given an ensemble of input states e := {pi-,Pi\ where pi are the probabilities of 
states Pi, and pi are states of n— input qubits, the mutual information is defined as 

/„(£) := S{£^^\Y.P^pi)) - Y,p,S{£^{p,)), (1) 

i i 

where S{p) = —tr{p\og p) is the von Neumann entropy of a state p. 

A basic question of information theory is whether there is any advantage in using 
entangled states as input states, that is, whether or not encoding the classical data 
into entangled rather than separable states increases the mutual information. For the 
case when multiple uses of the channel are not correlated, there are partial evidence 
based on studying concrete examples [I], [2], [3]that the optimal states are separable 
and hence there is no advantage in using entangled states. 

However if multiple uses of the channel are correlated, then there are pieces of 
evidence that entangled states become advantageous, once the correlation exceeds a 
critical value. 

In [H [5] a Pauli channel with partial memory, was studied. The action of the 
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channel on two consecutive qubits is given by the fohowing map: 

£{p) = ® (^j)p(.(^i ® (2) 

id 

where Pij denotes the probabihty of two consecutive errors (Ji,aj and is defined as: 

Pij = (1 - n)piPj + p6ijPi = [{I - ii)pi + pSij]pj. (3) 

Here pi is the probabihty of the error operator cjj, i = 0, 1,2,3 on one single qubit. 
Thus with probability /x the channel acts on the second qubit with the same error 
operator as on the first qubit, and with probability (1 — fi) it acts on the second qubit 
independently, hence the name partial memory. 

Physically the parameter ^ is determined by the relaxation time of the channel 
when a qubit passes through it. In order to remove correlations, one can wait until 
the channel has relaxed to its original state before sending the next qubit, however 
this lowers the rate of information transfer. Thus it is necessary to consider the 
performance of the channel for arbitrary values of to reach a compromise between 
various factors which determine the final rate of information transfer. 

In [4] it was shown by analytical arguments and numerical searches in the space of 
two-qubit input states, that for the depolarizing channel ^6] there is a sharp transition 
in the type of optimal states from separable to maximally entangled states when the 
memory parameter passes beyond a critical value i^c- A similar result was estab- 
lished analytically by the same authors in [5] who considered a particularly symmetric 
channel with (po = Ps and pi = p2)- Inspired by these works, similar results have 
been shown for generalized Pauli channels acting on states of arbitrary dimensions or 
qudits in [71 [8] and for bosonic Gaussian channels in [9]. 

However all the above studies have been restricted to strings of states of length 
n = 2. As is well known from theorems on data compression in classical [lOj and 
quantum [TT] information theory, one should encode classical data into arbitrarily 
long sequences of bits or qubits. This is quite necessary if one wants to encode with 
arbitrarily high probability only typical sequences and achieve maximum compression 
of data and minimum decoding errors. 

This requirement is also refiected in the definition of classical capacity of quantum 
channels which is given by 

C := lim Cn (4) 

n^oo 

where ^ 

Cn ■■= -Supelnie), (5) 

in which n is the length of input string of states. 

Thus the question of whether entanglement enhances the mutual information or 
not should be addressed for strings of arbitrary length and not just strings of length 
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2. More concretely one may ask if it is advantageous to encode 2" bits of information 
into completely separable states of n qubits or else, into maximally entangled states. 
Only then one can make precise statements as to the enhancement effect of entangle- 
ment on the mutual information and capacity of quantum channels. 

We should stress that the answer to this question, whatever it may be, does not 
invalidate the previous results, that entangled states give a higher mutual informa- 
tion than separable states, as long as we use a correlated channel "twice". However 
if consecutive uses of a channel are correlated, and we have to encode our data into 
arbitrary long strings, that is we are streaming the data into the channel, then we 
should consider the effect of this correlation on all the qubits of the strings. Thus 
we are asking the question of "which states maximize the mutual information in the 
space of all states of n— qubits?" 

Unfortunately answering this question in its full generality is almost intractable, 
for at least two reasons. First it is an extremely difficult task to optimize the mutual 
information over all ensembles of n qubit states, due to the exponentially large num- 
ber of parameters involved. Second we do not have good measures to characterize 
various types of entanglement in multi-partite states. For example in contrast to the 
two-party case in which we have only one class of entangled states, for n-parties there 
are numerous inequivalent classes of entangled states the number of which grows very 
rapidly with the number of n fT2]. 

Nevertheless we can gain an insight into this problem by comparing only two types 
of ensembles, namely an ensemble of pure product states and an ensemble of pure 
maximally entangled states like the Greenberger-Horne-Zeilinger (GHZ) states. We 
should stress that even in this case we are still faced with a strongly correlated quan- 
tum many body system which poses many computational difficulties for its solution. 
There are several reasons in favor of this restricted choice. First following the work of 
[5] we will show in the sequel that the problem of optimizing the mutual information 
over input ensembles reduces for Pauli channels to finding a single pure state that 
minimizes the output entropy. Second, previous examples (HO [HI [7] mentioned above 
show that as we vary the correlation parameter of the channel the optimal input 
state (which minimizes the output entropy) changes sharply from a separable state 
to a maximally entangled state and for no value of this parameter a state with an 
intermediate value of entanglement is optimal (We will elaborate on this point later 
in the introduction). Finally an analytic calculation of the output entropy which re- 
quires diagnolization of a 2" x 2" matrix is impossible for an arbitrary n— qubit pure 
state containing many parameters. 

Now for the elaboration mentioned above: there is not a single class of maximally 
entangled states for arbitrary n. For example for n = 3 there are two inequivalent 
classes which can not be transformed to each other by invertible local operations. 
Lack of knowledge of all these classes for arbitrary n and the particular simplicity 
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of the GHZ states compels us to consider only this class analytically. In order to 
substantiate our arguments we also consider other types of encoding of input states, 
like strings of Bell states by numerical means. However due to the exponential growth 
of the required time, we have been able only to consider strings of a few number of 
Bell states which again lead to the same result as stated above. 

We have presented in figures ^ and ([6]) the entropy of output states for several 
other types of encoding for strings of length 3 and 4. 

These figures clearly show that for n = 3 the optimum input state is a separable state 
and for n = 4 

the minimum output entropy state is separable for small value of correlation and 
one or the other type of entangled states for high value of correlation. However in 
all types of encodings the threshold parameter increases with the length of the strings. 

Does these results prove conclusively that encoding classical data into entangled 
states can not enhance the capacity of quantum channels? Certainly no, because we 
have not made an exhaustive search over the space of all n— party states. Never- 
theless our result casts doubt on the previous hope that this type of entanglement, 
namely encoding classical data into entangled input states, may increase the capacity 
of quantum channels for transmitting classical data. 

The structure of this paper is as follows: In section ([2]) we consider the Pauli 
channel with partial memory and calculate its output states when we pass through 
it a string of n-qubit in either separable or GHZ form. In section ([3]) we diagonalize 
the output states and find the eigenvalues of the output states in these two cases 
to calculate the output entropies and find the critical value of memory above which 
GHZ states take over the separable states in maximizing the mutual information. 
In section @ we consider other types of entangled states for encoding where we re- 
strict ourselves to strings of length n = 3 and n = 4. 

Finally section ([5]) concludes the paper with a discussion and summary of the results. 
Appendix A contains some details of calculations. 

2 The passage of a string of qubits through a PauU chan- 
nel with partial memory 

2.1 Action of the channel 

The action of a Pauli channel with partial memory on a string of n qubits is a natural 
generalization of equation ([2|). Before considering the general case, it would be helpful 
to study the simpler case of n = 3. In this case we have 

£^'^\P) = XI ^ijkicTi ^ CTj ® 0-k)p{0-i ® O-j «) (6) 
ijk 
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(i-n)"PiPjPk + i^(i-^)PiPj + n(i-^)PjPj + '"Pi 

Figure 1: Various types of errors on a string of three qubits and their corresponding 
graphs. The rightmost graph represents an error which repeats for the second and 
third bits with probabihty /x^ and the leftmost graph represents three independent 
errors. 



The memory parameter fi is contained in the probabilities Pijk which determine the 
probability of the errors aj ^ a^- Recalling that (1 — /i) is the probability of 
independent errors on two consecutive qubits , and /U is the probability of identical 
errors, P^jk can be written as follows: 



Pijk = [(1 - lAVi + - ^J')Pj + P-^j,k\Pk- 



(7) 



A good way to visualize the pattern of errors is via diagrams depicted in figure ([I]). 
A dot with a Latin index say i on it represents an error CTi which happens with 
probability pj, and a line represent correlation between two consecutive errors which 
happens with probability /u. Thus the pattern of errors for a string of three qubits is 
the one shown in figure ([T]) and is concisely represented in equation ([7]). 

Note from figure ([1]) that the sum of probabilities of all types of errors on three 
qubits adds to unity as we expect: 



1. 



(8) 



The action of the channel on a string of n— qubits is given by 

3 



=1 



where 



n-l 



Pil-in = Pin n ~ /^)^'»™ + /^<^im,Wl] 



(9) 



(10) 



m=l 



Thus in passing through the channel any two consecutive qubits undergo random 
independent errors with probability 1 — /i and identical (correlated) errors with prob- 
ability This should be the case if the channel has a memory depending on its 
relaxation time and if we stream the qubits through it. 



2.2 Properties of the channel 

Since any two Pauli operators either commute or anti-commute with each other, the 
channel has the following very important property 

f(")(C/pC/t) = [7^(")(p)C/t, (11) 
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where U is the n— fold tensor product of any combination of PauH operators. 
Therefore for any state p and any operator U of the above form we have 

5(^(")(C/pC/t)) = (12) 

where S is the von-Neumann entropy. 

Following the arguments of [5] , we now see that the mutual information is saturated 
by an equiprobable ensemble of the form 

e = {Pii,i2,-in ■= (o-ji ® ■■■f^i„)/5*(crii '^■■■(TiJ^}, (13) 

where p* is the state which minimizes the output entropy. The reason is that the 
state Z)ii,i2,---ijv Pii,i2,-iN commutes with all the irreducible representation of the Pauli 
group on n qubits and hence is proportional to the identity. Thus for an equiprobable 
ensemble of the above type, the first term of ([T]) is maximized while the second term 
is minimized due to the minimum output entropy of p* . 

In this way an upper bound for the mutual information is obtained, namely 

/n(^("))<n-S(f(")(p*)). (14) 

Thus the problem of finding the optimal ensemble for maximizing the mutual infor- 
mation reduces to finding the single state p* which minimizes the output entropy. 
Moreover this state can be taken to be a pure state. To see this we again repeat the 
argument of [5] for completeness: any state p* has a decomposition into pure states 
given by p* = J2iPi\'^i){^i\- Concavity of S entails that 

S{p*)>J:P^S{m)>S{\^*)), 
i 

where |^*) is the state with minimal entropy in the decomposition. However by 
definition of p* as the state with minimum entropy we should have p* = |^'*)(^'*|. 
This completes the proof that we should only search for a single state to find the 
optimal ensemble. 

2.3 The output states of the channel 
2.3.1 Strings of length n = 3 

For simplicity let us first consider strings of length n = 3. We consider a specific 
type of symmetric Pauli channel, one for which Po = Ps = P and Pi = P2 = with 
p -\- q = ^. This type of channel was first considered in [5j (for two-qubit strings) for 
which analytical calculations were shown to be possible due to the extra symmetry 
£i^){p) = ^(2)((j3 (g, a^pas ® as). 

Using the definition of the channel in equation ([6]), a straightforward but lengthy 
calculation gives the output states relating to separable |000) and GHZ -^{\000) + 
|111)) input states (see the Appendix for the general case of arbitrary n). We find 
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1 

f(3)(|000))= Papj\af3-f){a(3-f\, (15) 

a/37=0 

and 

1 

£^'\\GHZ))= ^ Pap^i\aPj){aPj\ + \a,P,j){a,P,-f\), (16) 

a/37=0 

where a = a + 1 mod 2, and 

-Pa/37 = [(1 - M)% + M<^a,/3] [(1 - + M<^/3,7]^7' (1^) 

with r]o = 2p and r]i = 2q. Note that Pais-y is structurally similar to Pijk (although 
their indices have different ranges), which help us in writing the output states for 
strings of arbitrary length. 



2.3.2 Strings of arbitrary length 

The output state of the channel depends on whether the length of the string is even 
or odd. In the appendix wc show that for general length n, we have 



fW(|0)«") = Yl 

2^^ — 1 

£^''\\GHZn)) = [^«(|a)(a| + \a){a\) + Qa{\a){a\ + |a)(a|] , (18) 

where \a) = \ai,a2 - ■ ■ an), 



a=0 



n-1 



(19) 



i=l 



and 



Qa = < 



--1 

r o ^ 



I 0, 



n = odd. 



(20) 



3 The entropies of the output states 

In this section we find the analytic expressions for the eigenvalues of the output den- 
sity matrices, when the input states are respectively the separable |0) and the GHZ 
state \GHZ). 

Since the output state of the separable state is diagonal, its eigenvalues are simply 
given by Aq = Pq. 
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Figure 2: The output entropy of separable(...) and GHZ( — ) input states with size 
n = 3 and n = 7, as a function of memory parameter /i in p=0.4. It seems that 
entangled states do not have any advantage over separable states for strings of odd 
length. 

To find the eigenvalues of £{\GHZ)) we note that this state is as embedding of 
blocks of the form: 

1 I Pa ~\~ Pa Qa ~l~ Qa j (21) 

2 \ Qa ~\~ Qa Pa ~\~ Pa J 

in different non-overlapping positions of a matrix. Thus the eigenvalues of the output 
state £{\GHZ)), are a collection of the eigenvalues of these block. Thus we find the 
final form of eigenvalues for both input states: 

\a = Pa for |0), 

Xa = \{Pa + Pa±{Qa + Qa)) f OT \GHZ). (22) 

The subscript, a = aia2 ■ ■ ■ aj\f, range over the the numbers {0, 2" — 1} for 
separable states. For the GHZ states the same range of subscripts produces the 
eigenvalues twice, since a and a lead to the same eigenvalues. So the calculated 
entropy for the whole range of a G {0, 2" — 1} should be halved to obtain the correct 
final value. 

From these eigenvalues we can calculate the output entropies 

Sout = — ^ Xa log Xa 
a 

as functions of p and /i. For small values of n the entropy can be evaluated in closed 
form. However as we increase n the number of eigenvalues increases exponentially 
and a closed expression is not possible. Figures ^ and ^ show the output entropy 
for the separable and GHZ states for strings of different length as a function of the 
memory parameter fi. It is seen that for odd length of the string, the separable states 
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Figure 3: The output entropy of separable (...) and GHZ( — ) input states with size 
n = 4 and n = 10, as a function of memory parameter fi for p = 0.4. Entangled states 
seems to have an advantage for strings of even length. 

are better than the GHZ states for all values of the memory parameters. However for 
strings of even-length the GHZ states are better once the memory parameter passes a 
critical value. Figure (jH) shows the value of this critical memory as a function of the 
length of the string for a typical value of the error parameter. It is seen that as the 
length of the string increases this critical value increases toward unity. Thus for very 
large strings we conclude that entangled states loose their advantage over separable 
states altogether. 



4 Other types of encoding 

In order to substantiate our arguments, we depict in figures ([5] ) and ([6]) the output 
entropy for several types of other states for strings of length n = 3 and n = 4. Each 
of these states gives rise to an equi-probable ensemble as defined in (fT3]) . 
The calculations for these types of states have been done as outlined in previous 
sections. For n = 3 we have considered the additional states 



V'^) «) |o) 



and 



|o) ® |V'+) 



where 1-0+) = ^(|00) + |11)) is a Bell state and a state of the form 



\W) = ^(|100) + |010) + |001) + |111)). 



For n = 4 we have considered the additional states 



IV'^) «) |oo) 



0) (g> (E> |0) and |00) \^+). 



1 1 1 1 1 1 1 1 

0.95 - 
0.9- 

0.85 - • 

H 0.8- 
0.75 - 
0.7- 
0.65 - 

0.6^ ' ' ' ' ' 

2 4 6 8 10 12 14 

n 

Figure 4: Critical memory as a function of the size of the input string for p = 0.4. 



Figure ^ shows that for n = 3 separable states are optimal for all values of fi while 
figures ([6]) and ([7]) show that the optimal state changes from a separable state to an 
entangled state as we increase fj,. It is seen that a only a string of two Bell states, or a 
GHZ state have a lower entropy then the separable state and other forms of partially 
entangled states are not better than separable states. Moreover it is seen that when 
the memory parameter increases a string of two Bell states is slightly better than the 
GHZ state. 



5 Summary 

We have compared the mutual information for a memory Pauli channel for two en- 
semble of input states of arbitrary length, a separable ensemble and an ensemble 
constructed from the entangled GHZ states. Our results show that for odd lengths of 
the strings, separable states lead to a higher mutual information. However for strings 
of even length GHZ states outperform the separable states when the memory of the 
channel exceeds a critical value. The value of this critical memory increases toward 
unity as the length of the string increases implying that for arbitrarily long sequences 
still the separable and GHZ states perform equally well. 

Although previous works [H El 13 El E] have shown that entangled states are advanta- 
geous for encoding classical data into two qubits, our results imply that this advantage 
may not lead to a higher rate of information transfer, since general theorems of in- 
formation theory require that only typical sequences be encoded and these should be 
encoded into arbitrary large sequences for which we have shown that this advantage 
no longer exists. 
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0.2 0.4 0.6 0.8 1 

Figure 5: The output entropy for different entangled input strings of length n=3, and 
p = 0.4. Separable states are better than other states for strings of odd length. 
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0.2 0.4 0.6 0.8 1 



Figure 6: The output entropy for different entangled input strings of length n=4, 
and p = 0.4. Again completely separable states have lower entropy than partially 
entangled strings. 
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0.2 0.4 0.6 0.8 1 

Figure 7: The output entropy for different entangled input strings of length n=4, 
and p = 0.4. For high value of memory GHZ and pairs of Bell states take over the 
separable strings. 
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6 Appendix A 

Here we briefly explain how to calculate the output states of the channel. The deriva- 
tion is simplified if we relabel the Pauli error operators and the corresponding proba- 
bilities by two indices instead of one. Thus the Pauli operators, including the identity 
operator / are denoted by a^^ where a, (3 = 0,1. Such an error operator acts with 
probability p^^. We have (To,o = I, <7o,i = cr^, aifi = ax, and ui^i = iay whose 
actions are compactly written as 



k=0 



The channel acts on a single qubit as: 



(23) 



a,/3=0 



t 

0.(3 ' 



From ([9]) and (fTO|) . it's action on a string of n qubits, is given by : 

a,/3=0 



in which a = a\a2 ■ ■ ■ an, P = P1P2 ■ • • Pn, and 

X rAp) = (o' „ ^ cr ■■■0a )p(a „ a „ 



and 



n-l 



i=l 



P. 



(24) 



It is now easy to calculate the output states of separable and GHZ input states: 

fW(|0)(0|)= Y ^...x.,,(|o)(o|) 

a,/3=0 

and 



(25) 

(26) 
(27) 

(28) 



£(-\\GHZ)) = ]- Y P.,, X„.,(|0)(0|)+x.,,(|0)(l|)+x.,,(|l)(0|)+X..,(|l)(ll 



a,P=0 

From (I26p and ()23|) we have: 



(29) 



XaA\0){0\) 
XaA\^){l\) 
Xa,/3(|0)(1|) 
XaA\^){0\) 



a){a\ 
a) {a\ 

a)(a|(-l)S-i^' 
)(a|(-l)ELift, 



a 



(30) 
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in which a = a + 1 mod 2. Combining these with (j28p the output states are found to 
be: 



1 



f(")(iO)(0|) = Pa,p\»)i»l 

o,/3=0 

£^^\\GHZ)) = i ^ P„,^(|a)H + |a)(a|) 



a, 13=0 
1 



+ E ^'a,M-l)^"=^''"(l«)(«l + l«)(«l)- (31) 

a,/3=0 



If we define Pa, and as follows: 

2"-l 2"-l 



= E = E ^«,/3(- 1)^^-1^% (32) 

/3=0 /3=0 



the output states take the simple form: 

2"-l 



fW(|0)(0|) = E^-I«)(«l' 

2" — 1 

= i ^ [p^(|a)(a| + |a)(a|)+Q„(|a)(al + la)(a|)] . (33) 



For a symmetric Pauli channel in which poo = Poi = Pio = Pii = Q ^-nd p+g = ^ 
the expressions of and Qa are simplified to 



Pa = n [(1 - ^)^"» + ' (34) 



i=l 

and 



Qa 



n — — 1 



, n = odd 

(35) 

where ?7o = 2p and r]i = 2q. 
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